' UTILITY 
PATENT APPLICATION 
TRANSMITTAL 

under 37 CFR 1.53(b)) 


Attorney Docket No. 


081829.000037 •^-^^ iSS 

1^ 

^j^M 




First Named Inventor 
or 

Application identifier 


JOHN M. BAIRD jgOg 
DAVID A. MONROE ^^^M 


ADDRESS TO: 

Assistant Commissioner of Patents 
Box Patent Application 
Washington, DC 20231 


Title 


MULTIPLE VIDEO DISPAY CONFIGURATION AND 
BANDWIDTH CONSERVATION SCHEME FOR 
TRANSMITTING VIDEO OVER A NETWORK 




Express Mail No. 


£:i283351515US 



APPLICATION ELEMENTS 

See MPEP chapter 600 concerning utility patent application contents 

1 . X Fee Transmittal Form VTO/SB/17 (submit in duplicate) 

2. 16 Specification [Total Pages: 16 1 

3. _X_ Drawing(s) (35 USC 1 13) [Total Sheets: 4 1 

4. Oath or Declaration [Total Pages: ] 

a. Newly executed (original or copy) 

b. Copy from a prior application (37 CFR 1 .63(d)) 

(for continuation/divisional with No. J 7 completed) 

[Note No. 5 below] 
i. _ DELETION OF INVENTOR(S) 

Signed statement attached deleting 
inventor(s) named in the prior application, see 
37 CFR 1.63(d)(2) and 1.33(b). 

5. Incorporation By Reference (useable if No. 4b is 

checked) 

The entire disclosure of the prior application, from which a copy of 
the oath or declaration is supphed under No. 4b, is considered as 
being part of the disclosure of the accompanying application and is 
hereby incorporated by reference therein. 

6. Microfiche Computer Program (Appendix) 

7. Nucleotide and/or Amino Acid Sequence Submission 

(if applicable, all necessary) 

a. Computer Readable Copy 

b. Paper Copy (identical to computer copy) 

c. Statement verifying identity of above 

copies 

ACCOMPANYING APPLICATION PARTS 



8, Assignment Papers (cover sheet & document(s) 

9. _ 37 CFR 3,73(b) Statement 

(when there is an assignment) 

Power of Attorney 

10. English Translation Document (if applicable) 

11- Information Disclosure 

Statement (IDS)/PTO-1449 
Copies of IDS Citations 

12. Preliminary Amendment 

13. X Return Receipt Postcard (Itemized) 

14. Small Entity Statement(s) 

Statement filed in prior application. Status still 

proper and desired 

15. Certified Copy of Priority Document(s) 

(if foreign priority is claimed) 

16. Other: 



17. If a CONTINUING APPLICATION, check appropriate blank and supply the requisite information: 
Continuation X 

Divisional X of prior application No.: / 

Continuation-in-part (CIF) X 

18> Correspondence Address 



Customer Number or Bar Code Label 



or 



X Correspondence address below 



(Insert Customer No. or Attach bar code label here) 



Name 



Attn: Robert C. Curfiss 
BRACEWELL & PATTERSON, L.LJ. 



Address 



711 Louisiana, Suite 2900 



City 



Houston 



State 



Texas 



Zip Code 



77027-9095 



Country 



U,S.A. 



Telephone 



(713) 221-1430 



Fax 



(713) 221-2113 



Date 



Robert C. Cufiss, Reg. No. 26,540 



FEE TRANSMITTAL 

Patent fees are subject to annual revision on October 1 . 
iiicdC oTC Liic iccb ciict-iivc vjIOLUOCI 1, iyy I . 
Small Entity payments must be supported by a small 
entity statement, otherwise large entity fees must be 
paid. See Forms PTO/SB/09- 12. 
37CFR§§ 1.27 & L28 


Complete if Known 




Application Number 






Filing Date 






First Named Inventor 


JOHN M. BAIRD, DAVID A. MONROE 




Examiner Name 






Group/ Art Unit 




Total Amount of Payment $445.00 


Attorney Docket No. 


081829,000037 



METHOD OF PAYMENT (check one) 



1. The Commissioner is hereby authorized to charge 

indicated fees and credit any overpayments to; 
Deposit Account No.; 50-0259 
Deposit Accoxmt Name; 

Bracewell & Patterson. L.L.P. 

X Charge any additional Fee Required Under 37 CFR 
§§ 1.16& 1.17 

Charge the Issue Fee Set in 37 CFR § 1 . 1 8 at the 

Mailing of the Notice of Allowance 



2, X Payment Enclosed: 
Money Order 



X Check 
Other 



FEE CALCULATION 



1. Basic Filing Fee 


Large 
Entity 
Fee ($) 


Small 
Entity 
Fee ($) 


Fee 
Description 


Fee Paid 


$710 


$355 


Utility Filing Fee 


$355 


$310 


$155 


Design Filing Fee 


S 


$480 


$240 


Plant Filing Fee 


$ 


$760 


$380 


Reissue Filing Fee 


$ 


$150 


$ 75 


Provisional Filing Fee 


$ 




Subtotal (1) 


$355 



2. Extra Claim Fees 



Claims 



Total 



Indep. 



25 -20** = 



1 -3** = 



Extra 



Multiple Dependent 



Fee 
(below) 



$ 18 



$78 



= $ 90.00 



Fee Paid 



$ 0 



$ 0 



Large 
Entity 
Fee ($) 



$ 18 



$ 78 



$260 



$ 78 



$ 18 



**or number previously paid, if greater. 

For Reissues, see below 



Small 
Entity 
Fee ($) 



$ 9 



$ 39 



$ 130 



$ 39 



$ 9 



Fee 
Description 



Claims in excess of 20 



Independent claims in excess of 3 



Multiple dependent claim, if not paid 



**Reissue independent claims over original 
patent 



**Reissue claims in excess of 20 and over 
original patent 

Subtotal (2) I $ 



FEE CALCULATION (continued) 



3. Additional Fees 



Large 


Small 


Fee Description 


F 


Entity 


Entity 






$ 130 


$ 


65 


Surcharge - late fee or oath 


$ 


$ 50 


$ 


25 


Surcharge - late provisional 
filing fee or cover sheet 


S 


$2,520 


$2,520 


Request for Reexamination 


$ 


$ 110 


$ 


55 


Extension for reply within 
first month 


$ 


$ 380 


$ 


190 


Extension for reply within 
second month 


$ 


$ 870 


$ 


435 


Extension for reply within 
third month 


$ 


$1,360 


$ 


680 


Extension for reply within 
fourth month 


$ 


$1,850 


$ 


925 


Extension for reply within 
fifth month 


$ 


$ 300 


$ 


150 


Notice of Appeal 


$ 


$ 300 


$ 


150 


Filing a brief in support of 
an appeal 


$ 


$ 260 


$ 


130 


Request for oral hearing 


$ 


$ 110 


$ 


55 


Petition to revive - 
unavoidable 


$ 


$1,210 


$ 


605 


Petition to revive - 


s 






unintentional 




$1,210 


$ 


605 


Utility issue fee (or reissue) 


$ 


$ 430 


$ 


215 


Design issue fee 


$ 


$ 580 


$ 


290 


Plant issue fee 


$ 


S 130 


$ 


130 


Petitions to the 
Commissioner 


$ 


$ 50 


$ 


50 


Petitions related to 
provisional applications 


$ 


$ 240 


$ 


240 


Submission of Information 
Disclosure Statement 


$ 


$ 760 


$ 


380 


Filing a submission after 
final rejection (37 CFR 
1.129(a)) 


$ 



Other fee (specify): 
Other fee (specify): 



Fee Paid 



I Subtotal (3) 



$0 




edby 

Z. Curfiss., Reg. No. 26,340 



KIMBAB\0424 18.00 17 
HOUSTON\939806 



1/16 

TITLE: MULTIPLE VIDEO DISPLAY CONFIGURATIONS AND BANDWIDTH 

CONSERVATION SCHEME FOR TRANSMITTING VIDEO OVER 
A NETWORK 
E^VENTOR: JOHN M. BAIRD, DAVID A. MONROE 
BACKGROUND OF INVENTION: 

1 . FIELD OF INVENTION: 
[0001] The invention is generally related to digital video transmission systems and is specifically 

directed to a method and apparatus for compressing and distributing digitized video over a 
network for supporting the transmission of live, near real-time video data in a manner to 
: n maximize display options while conserving bandwidth requirements. 

i2 2. DESCRIPTION OF THE PRIOR ART: 

:g)002] Cameras employ digital encoders that produce industry-standard digital video streams 

m such as, by way of example, MPEG- 1 streams. The use of MPEG- 1 streams is advantageous due 
to the low cost of the encoder hardware, and to the ubiquity of software MPEG-1 players. 
:= However, difficulties arise from the fact that the MPEG-1 format was designed primarily to 

j=£ support playback of recorded video from a video CD, rather than to support streaming of 'live' 
;2 sources such as surveillance cameras and the like. 

#003] MPEG system streams contain multiplexed elementary bit streams containing compressed 

video and audio. Since the retrieval of video and audio data from the storage medium (or 
network) tends to be temporally discontinuous, it is necessary to embed certain timing 
information in the respective video and audio elementary streams. In the MPEG-1 standard, 
these consist of Presentation Timestamps (PTS) and, optionally. Decoding Timestamps (DTS). 

[0004] On desktop computers, it is common practice to play MPEG- 1 video and audio using a 

commercially available software package, such as, by way of example, the Microsoft Windows 
Media Player. This software program may be run as a standalone application. Otherwise, 
components of the player may be embedded within other software applications. 
Media Player, like MPEG-1 itself, is inherently file-oriented and does not support playback of 
continuous sources such as cameras via a network. Before Media Player begins to play back a 
received video file, it must first be informed of certain parameters including file name and file 
length. This is incompatible with the concept of a continuous streaming source, which may not 
have a filename and which has no definable file length. Moreover, the time stamping 
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mechanism used by Media Player is fundamentally incompatible with the time stamping scheme 
standardized by the MPEG-1 standard, MPEG-1 calls out a time stamping mechanism which is 
based on a continuously incrementing 94 kHz clock located within the encoder. Further, the 
MPEG-1 standard assumes no Beginning-of-File marker, since it is intended to produce a 
continuous stream. 

[0005] Media Player, on the other hand, accomphshes time stamping by counting lOO's of 

nanoseconds since the beginning of the current file. 

SUMMARY OF INVENTION 
^0006] The subject invention is directed to a streaming video system for capturing, encoding and 

0 transmitting continuous video fi-om a camera to a display monitor via a network includes an 

^ encoder for receiving a video signal from the camera, the encoder producing a high-resolution 

output signal and a low-resolution output signal representing the video signal, a router or switch 
3 for receiving both the high-resolution output signal and the low-resolution output signal and a 

display monitor in communication with the router for selectively displaying either the high- 

2 resolution output signal or the low-resolution output signal. It will be understood by those skilled 
~; in the art that the terms "router and/or switch" as used herein is intended as a generic term for 

3 receiving and rerouting a plurality of signals. Hubs, switched hubs and intelligent routers are all 
included in the terms "router and/or switch " as used herein. 

[0007] The system supports a plurality of cameras and an encoder associated with each of the 

cameras, the high-resolution output signal and low-resolution output signal unique to each 
camera being transmitted to the router. A management system is associated with each display 
monitor whereby each of the plurality of display monitors is adapted for displaying any 
combination of camera signals independently of the other of said plurality of display monitors, 

[0008] The system of includes a selector for selecting between the high-resolution output signal 

and the low-resolution output signal based on the dimensional size of the display. The selector 
may be adapted for manually selecting between the high-resolution output signal and the low- 
resolution output signal Alternatively, a control device may be employed for automatically 
selecting between the high-resolution output signal and the low-resolution output signal based 
on the size of the display. In one aspect of the invention, the control device may be adapted to 
assign a priority to an event captured at a camera and selecting between the high-resolution 
output signal and the low-resolution output signal based on the priority of the event. 
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[0009] It is contemplated that the system will be used with a plurality of cameras and an encoder 

associated with each of said cameras. The high-resolution output signal and low-resolution 
output signal unique to each camera is then transmitted to a router or switch, wherein the display 
monitor is adapted for displaying any combination of camera signals. In such an application, 
each displayed signal at a display monitor is selected between the high-resolution signal and the 
low-resolution signal of each camera dependent upon the number of cameras signals 
simultaneously displayed at the display monitor or upon the control criteria mentioned above. 

[0010] The video system of the subject invention is adapted for supporting the use of a local- 

area-network (LAN) or wide-area-network (WAN), or a combination thereof, for distributing 
^ digitized camera video on a real-time or "near" real-time basis. 

=^ In the preferred embodiment of the invention, the system uses a plurality of video cameras, 

'l^ disposed around a facility to view scenes of interest. Each camera captures the desired scene, 

=^ digitizes (and encodes) the resulting video signal, compresses the digitized video signal, and 
sends the resulting compressed digital video stream to a multicast address. One or more display 

^ stations may thereupon view the captured video via the intervening network. 

Streaming video produced by the various encoders is transported over a generic IP network to 

□ one or more users. User workstations contain one or more ordinary PC's, each with an associated 

video monitor. The user interface is provided by an HTML application within an industry- 
standard browser, for example Microsoft Internet Explorer, 

[0011] The subject invention comprises an intuitive and user-fiiendly method for selecting 

cameras to view. The main user interface screen provides the user with a map of the facility, 
which is overlaid with camera-shaped icons depicting location and direction of the various 
cameras and encoders. This main user interface has, additionally, a section of the screen 
dedicated to displaying video from the selected cameras. 

[0012] The video display area of the main user interface may be arranged to display a single 

video image, or may be subdivided by the user into arrays of 4, 9, or 16 smaller video display 
areas. 

[0013] Selection of cameras, and arrangement of the display area, is controlled by a mouse and 

conventional Windows user-interface conventions. Users may: 
[0014] Select the number of video images to be displayed within the video display area. This is 

done by pointing and clicking on icons representing screens with the desired number of images. 
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[0015] Display a desired camera within a desired 'pane' in the video display area. This is done 

by pointing to the desired area on the map, then 'dragging' the camera icon to the desired pane. 
[0016] Edit various operating parameters of the encoders. This is done by pointing to the desired 

camera, the right-clicking the mouse. The user interface then drops a dynamically-generated 
menu list which allows the user to adjust the desired encoder parameters. 
[0017] It is often the case that the user may wish to observe more than 1 6 cameras, as heretofore 

discussed. To support this, the system allows the use of additional PC's and monitors. The 
additional PC's and monitors operate under the control of the main user application. These 
secondary screens do not have the facility map as does the main user interface. Instead, these 

=D secondary screens use the entire screen area to display selected camera video. 

1^018] These secondary screens would ordinarily be controlled with their own keyboard and 

;fj mouse interface systems. Since it is undesirable to clutter the user's workspace with multiple 
input interface systems, these secondary PC's and monitors operate entirely under the control of 
the main user interface. To support this, a series of button icons are displayed on the main user 

\2 interface, labeled, for example, PRIMARY, 2,3, and 4. The video display area of the primary 
monitor then displays the video that will be displayed on the selected monitor. The primary PC, 
then, may control the displays on the secondary monitors. For example, a user may click on the 
'2' button, which then causes the primary PC to control monitor number two. When this is done, 
the primary PC's video display area also represents what will be displayed on monitor number 
two. The user may then select any desired camera from the map, and drag it to a selected pane 
in the video display area. When this is done, the selected camera video will appear in the selected 
pane on screen number 2. 

[0019] Streaming video signals tend to be bandwidth-intensive. Furthermore, since each monitor 

is capable of displaying up to 16 separate video images, the bandwidth requirements of the 
system can potentially be enormous. It is thus desirable to minimize the bandwidth requirements 
of the system. 

[0020] To address this, each encoder is equipped with at least two MPEG- 1 encoders. When the 

encoder is initialized, these two encoders are programmed to encode the same camera source into 
two distinct streams: one low-resolution low-bit rate stream, and one higher-resolution, higher- 
bit rate stream. 

[0021] When the user has configured the video display area to display a single image, that image 
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is obtained from the desired encoder using the higher-resolution, higher-bit rate stream. The 
same is true when the user subdivides the video display area into a 2 x 2 array; the selected 
images are obtained from the high-resolution, high-bit rate streams from the selected encoders. 
The network bandwidth requirements for the 2 x 2 display array are four times the bandwidth 
requirements for the single image, but this is still an acceptably small usage of the network 
bandwidth. 

[0022] However, when the user subdivides a video display area into a 3 x 3 array, the demand 

on network bandwidth is 9 times higher than in the single-display example. And when the user 

subdivides the video display area into a 4 x 4 array, the network bandwidth requirement is 16 
;B times that of a single display. To prevent network congestion, video images ina3x3or4x4 
: ^ array are obtained from the low-resolution, low-speed stream of the desired encoder. Ultimately, 
;y no image resolution is lost in these cases, since the actual displayed video size decreases as the 

1^ screen if subdivided. That is, if a higher-resolution image were sent by the encoder, the image 

would be decimated anyway in order to fit it within the available screen area. 
\^ It is, therefore, an object and feature of the subject invention to provide the means and method 

for displaying "live" streaming video over a commercially available media player system. 
Q It is a fiirther object and feature of the subject invention to provide the means and method for 
'"^ permitting multiple users to access and view the live streaming video at different time, while in 

process without interrupting the transmission, 
[0023] It is a ftirther object and feature of the subject invention to permit conservation of 

bandwidth by incorporating a multiple resolution scheme permitting resolution to be selected 

dependent upon image size and use of still versus streaming images. 
[0024] Other objects and feature of the subject invention will be readily apparent from the 

accompanying drawings and detailed description of the preferred embodiment. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0025] Fig. 1 is a block diagram of a typical multi-camera system in accordance with the subject 

invention. 

[0026] Fig. 2 is an illustration of the scheme for multicast address resolution. 

[0027] Fig. 3 illustrates a typical screen layout. 

[0028] Fig, 4 is an illustration of the use of the bandwidth conservation scheme of the subject 

invention. 
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DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0029] The video surveillance system of the subject invention is specifically adapted for 

distributing digitized camera video on a real-time or near real-time basis over a LAN and/or a 
WAN. As shown in Fig, 1, the system uses a plurality of video cameras CI, C2. . .Cn, disposed 
around a facility to view scenes of interest. Each camera captures the desired scene, digitizes the 
resulting video signal at a dedicated encoder module El, E2. . .En, respectively, compresses the 
digitized video signal at the respective compressor PI, P2...Pn, and sends the resulting 
compressed digital video stream to a multicast address router R. One or more display stations 
Dl, D2...Dn may thereupon view the captured video via the intervening network N. The 

;B network may be hardwired or wireless, or a combination, and may either a Local Area Network 

U (LAN) or a Wide Area Network (WAN), or both. 

;lj)030] The preferred digital encoders El, E2. . .En produce industry-standard MPEG-1 digital 

video streams. The use of MPEG-1 streams is advantageous due to the low cost of the encoder 
hardware, and to the ubiquity of software MPEG-1 players. However, difficulties arise from the 

; fact that the MPEG- 1 format was designed primarily to support playback of recorded video from 

a video CD, rather than to support streaming of *live' sources such as cameras. 
MPEG-1 system streams contain multiplexed elementary bit streams containing compressed 
video and audio. Since the retrieval of video and audio data from the storage medium (or 
network) tends to be temporally discontinuous, it is necessary to embed certain timing 
information in the respective video and audio elementary streams. In the MPEG-1 standard, 
these consist of Presentation Timestamps (PTS) and, optionally, Decoding Timestamps (DTS). 
On desktop computers, it is common practice to play MPEG-1 video and audio using a 
proprietary software package such as, by way of example, the Microsoft Windows Media Player. 
This software program may be run as a standalone application, otherwise components of the 
player may be embedded within other software applications. 

[0031] Media Player, like MPEG-1 itself, is inherently file-oriented and does support playback 

of continuous sources such as cameras via a network. Before Media Player begins to play back 
a received video file, it must first be informed of certain parameters including file name and file 
, length. This is incompatible with the concept of a continuous streaming source, which may not 
have a filename and which has no definable file length. 

[0032] Moreover, the time stamping mechanism used by Media Player is fimdamentally 
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incompatible with the time stamping scheme standardized by the MPEG-1 standard. MPEG-1 
calls out a time stamping mechanism which is based on a continuously incrementing 94 kHz 
clock located within the encoder. Moreover, the MPEG- 1 standard assumes no Beginning-of-File 
marker, since it is intended to produce a continuous stream. In the present invention, a common 
MPEG-1 encoder IC is used to perform the actual MPEG compression of a digitized camera 
signal. The IC selected is a W99200F IC, produced by Winbond Corporation of Taiwan. This 
IC produces an MPEG Video Elementary Stream that contains the appropriate PTS information 
as mandated by the MPEG standard. 
[0033] When invoking Media Player to view the streaming camera video, it is first necessary to 

ifl inform Media Player of the file length. Since the camera produces a stream rather than a discrete 
;^ file, the file length is undefined. In order to overcome this problem all of the Media Player's 63- 
bit file length variables are set to 1 . Media Player compares this value to a fi-ee-running counter 
m that counts ticks of a 1 0 MHz clock. This counter is normally initialized to zero at the beginning 
of the file. Given 63 bits, this permits a maximum file length of approximately thirty thousand 
;~ years, longer than the useful life of the product or, presumably, it's users. This effectively allows 

the system to play streaming sources. 
1^034] The next problem arises when additional users attempt to connect to a stream that is 

already in progress. Media Player expects that file length and other related uiformation is 
normally sent only once, in a file header, and is not periodically repeated. Thus, users connecting 
later will not receive the file length information contained in the header. The subject invention 
has overcome this problem by developing a software 'front-end' filter, which examines and 
modifies data being passed from the network to Media Player. This software formulates a 
dummy video file header, and passes it to Media Player. The filter then examines the incoming 
video stream, finds the next sequential Video Header, and thereupon begins passing the 
networked video data to the Media Player decoder and Tenderer. This effectively allows users 
to 'tune in late', by providing Media Player with an appropriate file header. 
[0035] A further problem arises when the networked video data is passed to Media Player. Since 

the user has connected to the video stream after the start of the file, the first timestamp received 
by Media Player will be non-zero, which causes an error. To overcome this problem, the front- 
end software filter replaces each received timestamp with a value of (current timestamp minus 
first timestamp received), which effectively re-numbers the timestamp in the local video stream 
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starting with an initial value of zero. 
[0036] Any given source of encoded video may be viewed by more than one client. This could 

hypothetically be accomplished by sending each recipient a unique copy of the video stream. 
However, this approach is tremendously wasteful of network bandwidth. A superior approach 
is to transmit one copy of the stream to multiple recipients, via Multicast Routing. This approach 
is commonly used on the Internet, and is the subject of various Internet Standards ( RFC's). In 
essence, a video source sends its' video stream to a Multicast Group Address, which exists as a 
port on a Multicast-Enabled network router or switch. The router or switch then forwards the 
stream only to IP addresses, which have known recipients. Furthermore, if the router or switch 
can determine that multiple recipients are located on one specific network path or path segment, 
M the router or switch sends only one copy of the stream to that path. 

|p037] From a client' s point of view, the client need only connect to a particular Multicast Group 

Address to receive the stream. A range of IP addresses has been reserved for this purpose; 
essentially all IP addresses from 224.0,0.0 to 239.255.255.255 have been defined as Multicast 
Group Addresses. 

:J|)038] Unfortunately, there is not currently a standardized mechanism to dynamically assign 

Q these Multicast Group Addresses, in a way that is known to be globally unique. This differs from 

the ordinary Class A, B, or C IP address classes. In these classes, a regulatory agency assigns 
groups of IP addresses to organizations upon request, and guarantees that these addresses are 
globally unique. Once assigned this group of IP addresses, a network administrator may allocate 
these addresses to individual hosts, either statically or dynamically DHCP or equivalent network 
protocols. This is not true of Multicast Group Addresses; they are not assigned by any 
centralized body and their usage is therefore not guaranteed to be globally unique. 
[0039] Each encoder must possess two unique IP addresses - the unique Multicast Address used 

by the encoder to transmit the video stream, and the ordinary Class A, B, or C address used for 
more mundane purposes. It is thus necessary to provide a means to associate the two addresses, 
for any given encoder. 

[0040] The subject invention includes a mechanism for associating the two addresses. This 

method establishes a sequential transaction between the requesting client and the desired encoder. 
An illustration of this technique is shown in Fig. 2. 

[0041] First, the client requesting the video stream identifies the IP address of the desired 
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encoder. This is normally done via graphical methods, described more fully below. Once the 
encoder's IP address is known, the client obtains a small file from an associated server, using 
FTP, TFTP or other appropriate file transfer protocol over TCP/IP. The file, as received by the 
requesting client, contains various operating parameters of the encoder including frame rate, UDP 
bit rate, image size, and most importantly, the Multicast Group Address associated with the 
encoder's IP address. The client then launches an instance of Media Player, initializes the 
previously described front end filter, and directs Media Player to receive the desired video stream 
from the defined Multicast Group Address. 
[0042] Streaming video produced by the various encoders is transported over a generic IP 

|D network to one or more users. User workstations contain one or more ordinary PC's, each with 
an associated video monitor. The user interface is provided by an HTML application within an 
;;J 5 industry-standard browser, specifically Microsoft Internet Explorer, 

18)43] One aspect of the invention is the intuitive and user-friendly method for selecting cameras 

to view. The breadth of capability of this feature is shown in Fig, 3. The main user interface 
:™ screen provides the user with a map of the facility, which is overlaid with camera-shaped icons 
1^ depicting location and direction of the various cameras and encoders. This main user interface 
Q has, additionally, a section of the screen dedicated to displaying video from the selected cameras. 
[0044] The video display area of the main user interface may be arranged to display a single 

video image, or may be subdivided by the user into arrays of 4, 9, or 16 smaller video display 
areas. Selection of cameras, and arrangement of the display area, is controlled by the user using 
a mouse and conventional Windows user-interface conventions. Users may: 

• Select the number of video images to be displayed within the video display area. This is 
done by pointing and clicking on icons representing screens with the desired number of images. 

• Display a desired camera within a desired 'pane' in the video display area. This is done 
by pointing to the desired area on the map, then 'dragging' the camera icon to the desired pane. 

• Edit various operating parameters of the encoders. This is done by pointing to the desired 
camera, the right-clicking the mouse. The user interface then drops a dynamically-generated 
menu list that allows the user to adjust the desired encoder parameters. 

Some sample source is listed below: 

// this function responds to a dragStart event on a camera 
function cameraDragStart (i ) 

event . dataTransf er . setData ( "text" , currSite . siteMaps [currSite , currMap] . hotSp 
ots [i] .camera. id) ; 
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dragSpot = currSite . siteMaps [currSite . currMap] . hotSpots [i] ; 

event . dataTransfer, dropEf feet = "copy"; 

dragging = true; 

event . cancelBubble = true; 

} 

// this function responds to a dragStart event on a cell 
//we might be dragging a hotSpot or a zone 
function cellDragStart (i) 

{ 

} 
} 

// this function responds to a drop event on a cell input element 
function drop(i) 

{ 



if (dragSpot != null) 

{ 

} 

else if (dragZone 1= null) 
obj ect 

{ 

currMoni t or . zones [i] = dragZone; 
dragZone = null; 
dragZone 

zoneVideo (currMoni tor , id, i) ; 

} 

else 

{ 

} 

else 

{ 

dropCame ra I d ( cur rMoni tor , d , i ) ; 
s tartMoni torVideo ( currMoni tor , i ) 
displayCells () ; 
the monitor cells 

} 

} 

dragging = false; 

event . cancelBubble = true; 

} 



// dragging a hotSpot 
/ / dragging a zone 



// set the cell zone 
// null 

// start the video 



// setup hotSpot 

// start the video 
// redisplay 



In the foregoing code, the function: 

event. dataTransfer.setDataCHexf',currSite,siteMaps[currSU^ 



retrieves the IP address of the encoder that the user has clicked. The subsequent function 
startMonitorVideo(currMonitor, i) passes the IP address of the selected encoder to an ActiveX 
control that then decodes and renders video from the selected source. 
[0045] The system of includes a selector for selecting between the high-resolution output signal 

and the low-resolution output signal based on the dimensional size of the display. The selector 
may be adapted for manually selecting between the high-resolution output signal and the low- 
resolution output signal. Alternatively, a control device may be employed for automatically 
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selecting between the high-resolution output signal and the low-resolution output signal based 
on the size of the display. In one aspect of the invention, the control device may be adapted to 
assign a priority to an event captured at a camera and selecting between the high-resolution 
output signal and the low-resolution output signal based on the priority of the event. 
[0046] It is contemplated that the system will be used with a plurality of cameras and an encoder 

associated with each of said cameras. The high-resolution output signal and low-resolution 
output signal unique to each camera is then transmitted to a router or switch, wherein the display 
monitor is adapted for displaying any combination of camera signals. In such an application, 
_ each displayed signal at a display monitor is selected between the high-resolution signal and the 
•D low-resolution signal of each camera dependent upon the number of cameras signals 
\^ simultaneously displayed at the display monitor or upon the control criteria mentioned above. 
1^047] It is often the case that the user may wish to observe more than 1 6 cameras, as heretofore 

;S discussed. To support this, the system allows the use of additional PC's and monitors. The 
additional PC's and monitors operate under the control of the main user application. These 
\^ secondary screens do not have the facility map as does the main user interface. Instead, these 

secondary screens use the entire screen area to display selected camera video. 
[|M)48] These secondary screens would ordinarily be controlled with their own keyboards and 

mice. Since it is undesirable to clutter the user' s workspace with multiple mice, these secondary 
PC's and monitors operate entirely under the control of the main user interface. To support this, 
a series of button icons are displayed on the main user interface, labeled, for example, 
PRIMARY, 2,3, and 4. The video display area of the primary monitor then displays the video 
that will be displayed on the selected monitor. The primary PC, then, may control the displays 
on the secondary monitors. For example, a user may click on the '2' button, which then causes 
the primary PC to control monitor number two. When this is done, the primary PC's video 
display area also represents what will be displayed on monitor number two. The user may then 
select any desired camera from the map, and drag it to a selected pane in the video display area. 
When this is done, the selected camera video will appear in the selected pane on screen number 
2. 

[0049] Streaming video signals tend to be bandwidth-intensive. The subject invention provides 

a method for maximizing the use of available bandwidth by incorporating multiple resolution 
transmission and display capabilities. Since each monitor is capable of displaying up to 16 
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separate video images, the bandwidth requirements of the system can potentially be enormous. 
It is thus desirable to minimize the bandwidth requirements of the system. 
[0050] To address this, each encoder is equipped with at least two MPEG- 1 encoders. When the 

encoder is initialized, these two encoders are programmed to encode the same camera source into 
two distinct streams: one low-resolution low-bit rate stream, and one higher-resolution, higher- 
bit rate stream. 

[0051] When the user has configured the video display area to display a single image, that image 

is obtained from the desired encoder using the higher-resolution, higher-bit rate stream. The 
same is true when the user subdivides the video display area into a 2 x 2 array; the selected 

B images are obtained from the high-resolution, high-bit rate streams from the selected encoders. 

\^ The network bandwidth requirements for the 2 x 2 display array are four times the bandwidth 

;n requirements for the single image, but this is still an acceptably small usage of the network 
bandwidth. 

[0052] However, when the user subdivides a video display area into a 3 x 3 array, the demand 

1^ on network bandwidth is 9 times higher than in the single-display example. And when the user 
;^ subdivides the video display area into a 4 x 4 array, the network bandwidth requirement is 1 6 x 
that of a single display. To prevent network congestion, video images ina3x3or4x4 array 
are obtained from the low-resolution, low-speed stream of the desired encoder. Ultimately, no 
image resolution is lost in these cases, since the actual displayed video size decreases as the 
screen if subdivided. If a higher-resolution image were sent by the encoder, the image would be 
decimated anyway in order to fit it within the available screen area. 
[0053] While specific features and embodiments of the invention have been described in detail 

herein, it will be understood that the invention includes all of the enhancements and 
modifications within the scope and spirit of the following claims. 
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Claims 

What is claimed is: 

1 , A system for captiiring, encoding and transmitting continuous video from a camera to a 
display monitor via a network, comprising: 

a. An encoder for receiving a video signal from the camera, the encoder producing 
a high-resolution output signal and a low-resolution output signal representing the 
video signal; 

b. A switching network for receiving both the high-resolution output signal and the 
low-resolution output signal; 

c. A display monitor for in communication with the router for selectively displaying 
one of said high-resolution output signal and said low-resolution output signal. 

2. The system of claim 1, wherein the switching network is a hub. 

3. The system of claim 1, wherein the switching network is a switched hub. 

4. The system of claim 1, wherein the switching network is a router. 

5. The system of claim 1, further including a selector for selecting between the high- 
resolution output signal and the low-resolution output signal based on the dimensional 
size of the display. 

6. The system of claim 5, further including a selection device for manually selecting 
between the high-resolution output signal and the low-resolution output signal. 

7. The system of claim 5, further including a control device for automatically selecting 
between the high-resolution output signal and the low-resolution output signal based on 
the size of the display. 
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8 . The system of claim 5 , further including a control device adapted for assigning a priority 
to an event captured at a camera and selecting between the high-resolution output signal 
and the low-resolution output signal based on the priority of the event. 

9. The system of claim 5, wherein there is further included a plurality of cameras and an 
encoder associated with each of said cameras, the high-resolution output signal and low- 
resolution output signal unique to each camera being transmitted to the router, and 
wherein the display monitor is adapted for displaying any combination of camera signals. 

10. The system of claim 5, wherein the displayed signal at the display monitor is selected 
between the high-resolution signal and the low-resolution signal of each camera 
dependent upon the number of cameras signals simultaneously displayed at the display 
monitor. 

11. The system of claim 1, wherein there is further included a plurality of display monitors, 
each of which is in communication with the router, whereby each display monitor may 
selectively display the high-resolution signal and the low-resolution signal. 

12. The system of claim 11, wherein there is further included a plurality of cameras and an 
encoder associated with each of said cameras, the high-resolution output signal and low- 
resolution output signal unique to each camera being transmitted to the router, and 
wherein there is farther included a management system associated with each display 
monitor whereby each of the plurality of display monitors is adapted for displaying any 
combination of camera signals independently of the other of said plurality of display 
monitors. 

13. The system of claim 1, wherein the display monitor includes a mapping feature 
illustrating the location of the camera. 

14. The system of claim 1, wherein the output signal for the camera may be selected by 
activating the camera location on the mapping feature. 
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15. The system of claim 1, wherein the communications link between the router and the 
display monitor is a network. 

16. The system of claim 15, wherein the network is hardwired. 

17. The system of claim 15, wherein the network is wireless. 

18. The system of claim 15, wherein the network is a wide area network. 

19. The system of claim 15 wherein the network is a local area network. 

20. The system of claim 1, wherein the communications link between the encoder and the 
router is a network. 

21. The system of claim 20, wherein the network is hardwired. 

22. The system of claim 20, wherein the network is wireless. 

23. The system of claim 20, wherein the network is a wide area network. 

24. The system of claim 20, wherein the network is a local area network. 

25. The system of claim 1, further including a compressor between the encoder and the 
router. 
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ABSTRACT 

A system for capturing, encoding and transmitting continuous video from a camera to 
a display monitor via a network includes an encoder for receiving a video signal from the 
camera, the encoder producing a high-resolution output signal and a low-resolution output 
signal representing the video signal, a router for receiving both the high-resolution output 
signal and the low-resolution output signal and a display monitor in communication with 
the router for selectively displaying either the high-resolution output signal or the low- 
resolution output signal. The system supports a plurality of cameras and an encoder 
associated with each of the cameras, the high-resolution output signal and low-resolution 
output signal unique to each camera being transmitted to the router. A management system 
is associated with each display monitor whereby each of the plurality of display monitors 
is adapted for displaying any combination of camera signals independently of the other of 
said plurality of display monitors 
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